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OPTIMAL OUTPUT FEEDBACK CONTROL OF LINEAR 
SYSTEMS IN PRESENCE OP FORCING AND MEASUREMENT NOISE 

Ry Suresh M. Joshl 


SUMMARY 

The prohlem of obtaining an optimal control lav, which is constrained to 
be a feedback of the available measurements , is considered for both continuous 
and discrete-time linear systems subjected to additive white process noise and 
measurement noise. Necessary conditions are obtained for minimizing a quadra- 
tic performeuice function for both finite and infinite terminal time cases. The 
feedback gain matrices are constrained to be constant for the infinite terminal 
time cases. For all the cases considered, algorithms are derived for generat- 
ing sequences of feedback gain matrices which successively improve the perfomt- 
ance function. A nianerlcal example is given for the purpose of demonstration. 

INTRODUCTION 

Control system design for processes which suffer from process and measure- 
ment noise Is an important problem. If the process dynamics are linear, cmd if 
the process noise and the measurement noise are Gaussian and white, it is well 
known that the control law which minimizes a quadratic performance function Is 
a linear function of the optimal estimate of the state. Thus, the application 
of this control law necessitates the use of an online state estimator. This 
design approach may not be attractive from a practical viewpoint because of the 
high cost of the additional equipnent required. In addition, there exists a 
dangerous possibility of divergence of the state estimator when the noise input 
matrix, €uad/or the means of the forcing and measurement noise processes are not 



known accurately. 

For this reason, the design of a satisfactory controller, which needs the 
feedback only of the available plant measurements, is a problem of immense 
practical importance. There have been numerous recent attempts in this area. 
These have proceeded mainly in two directions: pole shifting techniq^ues using 

output feedback; and minimization of a quadratic performance function using 
output feedback. The former procedure is necessarily confined to deterministic 
systems, while the latter procediire is also useful for the practically impor- 
tant stochastic case, in the sense that the apriorl knowledge of the noise 
statistics can be used to advantage. This paper considers the latter approach. 

The noise-free version of the linear quadratic optimal, output feedback 
control problem was considered in references (l) through (4). The basic philo- 
sophy was to minimize the performance degradation caused by the constraint on 
the control law. The constrained optimal control law depends on the initial 
state; therefore, the approach was to minimize the value of the performance 
function averaged over the initial state (with apriorl known statistics), 
(references (3) and (U)); or to minimize the "worst” value of the performance 
function, when the initial state is known to lie within a hyperellipsoid in the 
state space (ref. (2)); or to minimize the maximum ratio of suboptimal and op- 
timal values of the performance fxmctions (raf. (l)). In all these cases, the 
problem was finally reduced to a complex nonlinear optimization problem. 

In references (3) and (it), the noise-free case was considered, and the 
algebraic necessary conditions were derived. In addition, design of optimal 
dynamic compensators of a prespecified order was also discussed in reference 
(U). In reference (5)» Axsater considered the stochastic problem, with white 
process noise, but no measurement noise, and derived the necessary conditions 
for optimality. McLane (ref. (6)), considered the above problem, with state 
and control dependent forcing noise, hut no measuranent noise. All the efforts 
described above considered only continuous time systems. In addition, measure- 
ment noise was assumed to be absent. In practice, however, measurement noise 
is almost always present; therefore, it is important to consider the degrading 
effect of the direct transmittal of measurement noise through output feedback. 

In reference (7), the discrete-time, finite terminal time problem was considered 
and necessary conditions were obtained using dynamic programing. However, the 
infinite terminal time problem was not considered, and a minimizing algorithm 
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was not developed. 

The purpose of this paper is to consider both continuous-time and discrete- 
time linear systems which are subjected to both forcing and measurement noise. 

The necessary conditions for optimality are derived for continuous-time systems 
in the first part, using the matrix minimum principle (ref. (8)). Both finite 
and infinite terminal time cases are considered, the control lav for the latter 
case being constrained to be a constant feedback of the noisy measurements. 
Algorithms are derived to give sequences of successively better control gains, 
for both finite and infinite terminal time cases. The discrete-time case is next 
considered. The necessary conditions are derived, using the discrete matrix 
minimxan principle, for both finite and infinite termianl time cases. For the 
finite terminal time case, it is shown that the necessary conditions coincide 
with those derived in reference (7) using dynamic programing, while for the in- 
finite terminal time case, the feedback gains are constrained to be constant. 
Algorithms are developed for all cases to generate sequences of feedback gains 
which successively improve the performance function. A continuous-time numeri- 
cal example is give for the purpose of demonstration. 

SYMBOLS 

n X n system matrix 
n X m input matrix 
A X n output matrix 
expected value operator 
m X H feedback matrix 
m X it matrix defined in the text 
Hamiltonian 
Lagranglan 
indices 

performance fvinctions for the finite and infinite 
terminal-time cases 

n X n costate matrix 

n X n Lagrange multiplier matrix 

terminal time for the discrete case 

n X n Riccati-type matrix 


A 

B 

C 

E 

G 

S 

H 

H 

J,J 

K 

K 

N 

P 



Q 

R 

S 

Tr 

t 

u 

V 

V 

W 

w 

X 

y 

iS(t) 

6(k) 

E 

I 


n X n weighting matrix for the state vector 
m X m weighting matrix for the input vector 
n X n terminal state weighting matrix 
Trace operator 
time 

terminal time 
m-vector input 

n X n forcing noise covariance matrix 
n-vector forcing noise 

Z X i measurement noise covariance matrix 
i^vector measurement noise 
n-dimensional state vector 
H-dimensional output vector 
Dirac delta function 
Kronecker delta function 
n X n state covariance matrix 
steady-state value of Z 


The superscript *'T" denotes the transpose of a matrix, and ”-l" denotes the 
inverse. 


CONTINUOUS-TIME SYSTEMS 

Finite Teminal Time Case 
The system is given by 

* A(t)x(t) + B(t)u(t) + v(t) (l) 

y(t)= C{t)x(t) + w(t) (2) 

where A{t), B(t), C(t) are n x n, n x m, and A x n matrices and x(t), u(t), and 
y(t) are respectively n x 1 , m x 1 , and il x 1 state vector, input vector, and 
output vector. v{t) and w(t) are white noise processes, with zero means, and 

E[v(t)v'^(T)] = V(t) 6 (t-t) (3) 
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E[v(t)v'^(T)] = W(t)6(t-T) (it) 

where V(t) > 0» W(t) > 0 are n x n and % x. I matrices, and 6(«) is the Dirac 
delta function. Also, 

E[v{t)w^(T)] = 0 (5) 

The initial state covariance matrix is assumed to he known; 

E[x(o)x*^(o)] = E(o) = 

Consider the problem of minimizing the functional 

I £[x^(t^)Sx(t^)] + I E J ^ [x'^(t)Q{t)x(t) + u'^(t)R(t)u{t)j dt (6) 

where Q(t) > 0, R(t) > 0, S > 0 are n x n, m x m, and n x n matrices. Suppose 

the control law is restricted to he a feedback of the output. 

u(t) = G(t)y(t) 

= G(t)C(t)x(t) + G{t)w(t) (T) 

where G(t) is the m x output feedback matrix. 

This formulation aJ-lows for direct transmittal of white noise into the 
system via feedback. It is clearly seen that the term E[u"*^(t)R(t)u(t ) ] is 
infinite, since E[w(t )w*^(t) ] « W(t)6(t-t). This can be avoided by including 
only that part of the control energy which does not contain white noise. Thus 
the following modified performance function is considered; 

J =|E[x’’(tj,)Sx(t^)] 

+ I Ej^^|x'^(t)Q(t)x(t) + |G(t)c(t)x(t))'^R(t)(G(t)c(t)x(t))|dt (8) 

The measurement noise is not directly included in the performance function, 
but the degrading effect because of its feedback is indeed taken into account 
via the state covariance evolution equation. Thus, since the state covariance 
matrix depends on the product of the feedback gain matrix and the measiirement 
noise, the measurement noise-dependent part of the input signal will be aut'o- 
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matically penalized in proportion to its covariance matrix W, as will be seen 
later. This formulation thus provides a design technique In which the knowledge 
of the noise statistics can he used to advantage. 

The evolution of the covariance matrix of the state x(t) can be easily de- 
rived as 

^7^ = (A + BGC)Z: + E(A + BGC)'^ + + V (9) 

at 

where E(t) “ E[x(t)x"(t)], E(o) = and the symbol *(t) is dropped for con- 
venience. 

The performance function of 

J 


It is required to minimize the J 
constraint (9). 

It is now possible to apply 
Define the Hamiltonian 

H(Z.G»K) = 

+ 

+ 

where K(t) is em n x n matrix of 
variance E(0) = and the matrices V(t) and W(t) are assumed to be known 
apriori. Using the matrix minimum principle, and the gradient matrices de- 
rived in reference (8), the necessary conditions for optimality can be derived 
as 


equation (8) can also be written as 
= I Tr[SE(t^)J 


€’ 


Tr[(Q + c'^g'^RGC)E 1 dt 


( 10 ) 


in (10) with respect to G subject to the 


the matrix minimum principle (ref. (8)), 


M' 


!tt[(q + c'^’g'^hgOEI 


I 


Tr |<(A + BGC)E + E(A + BGC) 


f*' n 

BGWG^B^ + ^ I ^^1 


( 11 ) 


costate variables. The initial state co- 


RGCEC^ + B^PEC^ + B^PBGW = 0 


( 12 ) 


dt 



BGC)^P 


+ P(A + BGC) + (Q + 


T T 

C G RGC 


>] 


(13) 
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^ = (A + BGC)i: + Z(A + BGC)"^ + BaWG^"^ + V (lU) 

2 (0) = Sp (15) 

P(t^) = S (16) 

In these equations, P(t) = 2K(t), and the symmetry of P(t) and K(t) is dbtained 
during the derivation because of the symmetry of the right-hand side of (13), 
and because S = S , Equations (12) to (l6) describe a nonlinear two-point 
boundary value problem. For a given G(t), equations (13) and (lU) are linear 
in P and S, while for given P and 2, equation ( 12) is linear in.G, It is inter- 
esting to note that, although the measurement noise-dependent portion of the 
control signal was not weighted in the performance function, the measurement 
covariance matrix W does tend to reduce the feedback gain G in equation (12), 
as expected. For the case with perfect measurements (W = O), the necessary 
conditions reduce to those of AxsSter (ref. (5)), while for the noise-free case 

(V = 0, W = 0), the necessary conditions reduce to those due to Levine, Johnson, 
and Athans (ref. (U)). 

Infinite Duration Case 

The necessary conditions obtained above require the solution of a complex, 
two-point boundary value problem, and the feedback gain G(t) obtained is time- 
varying. A natural extension of this problem is the constant-coefficient, 
infinite terminal time case, with G constrained to be a time-invarieuit matrix. 
Under these circumstances, with A, B, C, V, W constant, for a stabilizing out- 
put feedback gain matrix G, it is well known that the covarieince matrix Z(t) 
tends to a constant matrix J > 0 as t -♦■ “>. In the treatment below, it is as- 
sumed that, for the V, G, W, and the dynamics under consideration, S exists and 
is a positive definite matrix. This would indeed be true if (V + BGWG^B*^) is 
positive definite. 

In this case, if the terminal time t^ ■», the performance function of (lO) 

Ue infinite, since the integrand tends to a constant value. Therefore, it 
is meaningful to minimize the "cost rate": 

J ij" ^ Tr{(Q + c'^G^RGOeI dt (17) 
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or 


j - i Tr|(Q + c^g'^RGC)S|- 


(18) 


where t is the steady state (positive definite by assumption) solution of the 
covariance equation (9). Thus, the problem reduces to a static optimization 
problem. Defining the Lagrangian 

H(i,G,K) = I Tr [(Q + c'^g'^RGC)z] 

+ Tr jj(A + BGC)2 + S(A + BGC)"^ 

+ bgwg^b'^ + ^19) 

where K is a n x n constant matrix of Lagrange multipliers, the necessary con- 
ditions for a minimum are 


M 


0 , 




( 20 ) 


which finally reduce to the steady-state forms of equations (l2), (13), and (lU), 
with 2 replaced by 5 , and P » 2K = P . Thus the necessary conditions for the 
infinite terminal time problem, with control gains constrained to be constant, 
are simultaneous nonlinear matrix algebraic equations. It shoxild be noted that 
the noise-free case is not a simple extension of these results since, in that 
case, Z = 0 for a stable G. 

A Numerical Algorithm 

Considering first the finite terminal time case, let G (t) and G (t) be two 
feedback gains, such that 



•I -I -f T 1 IT T 

(A + BG^C)Z + Z (A + BG C) BG WG B + V 


( 21 ) 


i = 0, 1 

^ = -f(A + BG°C)'^P° + P°(A + BG®C) + Q + C^G°^RG°c] (22) 

dt L 

After a lengthy algebraic manipulation as outlined in Appendix A, it can 
be proved that 
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J{G°) - J(G^) = 

^ Tr J" ^ j|RG°CZ^C^ + + b’^P°BG^w|'^R“^ 

|rG°CZ^C^ + B^P^Z^c'^ + B^P°BG^w| 

- |rg^cz^c'^ + B^P*^Z^C^ + B^P°BG^|'^R“^ 

IrG^CZ^C*^ + b'^P^Z^C^ + B'^P°BG^w|j(CZ^C^)“^ dt 
+ - Tr j* ^ [(G^- G^)'^b'^P°B(G°- G^)jw dt (23) 

Thus, if G^ is chosen to satisfy 

RG^CZ^C^ + B^P^Z^C^ + B*^P°BG^W =0 (2l^) 


we have 

J(G°) - J(G^) > 0 (25) 

Thus, a minimizing algorithm is 
(a) choose an initial G^(t) 

(h) obtain P^(t) using (22) 

(c) solve (2lt) and (2l) simultaneously for Z^ and G^ 

(d) go to (h) after increasing the superscript by unity 

Thus, a successive reduction in J is obtained. In the proof of the algo- 
rithm, it has been assumed that Z(t) > 0. This will be true if Z(0) > 0; 
however, it is not necessary that Z(0) be positive definite for Z(t) to be 
positive definite. 

For the infinite terminal time case, after a similar manipulation (given 
in the Appendix A), it can be shown that equation (23) holds with the integral 
signs removed and replacing Z^. Therefore, the algorithm given in steps 
(a) - (d) will still hold, with equations (21) and (22) replaced by their 
steady-state versions, if each G is stable, S > 0 at each stage. 
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A NUMERICAL EXAMPLE 


The folloving continuous-time system is considered for the purpose of 
demonstration of the technique developed: 
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The choice was eurhitrary, the only restriction heing the stability of the matrix 
(A + BG°C). 

The program converged after five iterations, tot 

-6.879 E-01 -5.196 E-01 

-9.861 E-01 -3.993 E-01 

At each iteration, it was verified that (A + BGC) was stable. Positive 
definiteness of 2 followed because of the positive definiteness of V. The value 
of the performance function for the initial G was 3.^66, which was reduced to 
0.341*3 at the final iteration. 

DISCRETE-TIME SYSTEMS 

Finite Terminal Time Case 
Consider the discrete-time system 

x(k+l) = A(k)x(k) + B(k)u(k) + v(k) (26) 

y(k) - C(k)x{k) + w(k) (27) 

Notations and dimensions are the same as in the continuous case. v(k) and w(k) 
are zero mean, vhite noise processes, with 

E[v(k)v'^(i)] = V(k)6(k-i) (28) 

E[w(k)w^(i)] = W(k)6(k-i) (29) 

and 

E[v(k)w^ (i)] = 0 (30) 

E[x(o)x^(o)] » Z(o) = (given) 

where 6(») is the Kronecker delta function. 

V(k) > 0, W(k) > 0 

The performance function to be minimized is 
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S ix'^(k)Q(k)x(k) + u^(k)E(k)u(k)| 
k=0 ' ' 


+ I E[x^CN)Sx(N)3 


(31) 


subject to ( 26 ), (27), and the restriction that 

u(k) = G(k)y(k) 


= G(k)C(k)x(k) + G(k)w(k) 


Q(k) > 0, R(k) > 0, S > 0 


(32) 


The Kronecker delta function is mathematically well defined; thus the performance 
function of equation (31) can be simplified as given below; 


J = I V Tr ^|Q(k) + C^(k)G^(k)R(k)G(k)C(k)} Jl(k)j 


+ I Tr[G'^(k)R(k)G(k)W(k)] 

^ k=0 

+ |-Tr[SZ{N)) (33) 

T 

It is easy to show that the covariance matrix E(k) = E[x(k)x (k)] evolves 
according to 

E(k+1) = (A + BGC)I(k){A + BGC)'’^ + BGWg'^B^ + V (3U) 


In writing (3U), the symbol *(k) has been dropped for convenience in most of the 
right-hand side variables. Thus, the problem reduces to the minimization of J 
in ( 33 ) subject to the constraint (3i»), with E(0), W(k) and V(k) known apriori. 
The "discrete matrix minimum principle" given in reference (8) can be readily 
used. Define the Hamiltonian 


H(E(k),G(k),K(k+l)) 

= i Tr |(Q(k) + C^(k)G'^(k)R(k)G(k)C(k))E(k)| + Tr j G^ 
+ Tr|^(A(k) + B(k)G(k)C{k))E(k)(A(k) + B(k)G(k)C(k))^ 

+ B(k)G(k)W(k)G'^(k)B'^(k) + V(k)-E(k)j K'^(k+l)i 


(k)R(k)G(k)W(k) j 
(35) 
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In the treatment below, all the variables at time k are denoted without *(k), 
whereas the variables at time (k+l) are denoted with ‘(k+l). 

In ( 35 ), K(k+l) is the n x n matrix of "costate variables". Applying the 
discrete matrix minimum principle and the gradient matrix formulae of reference 
(8), the necessary conditions are 


G = . 

-(r + B^P(k+l)B)~^B'^P(k+l)AEC^(CEc'^ + W)"^ 

(36) 

P(k) = 

Q + C^g'^RGC + (a + BGC)"^P(k+l)(A + BGC) 

(37) 

E(k+1) = 

(A + BGC)E(k)(A + BGC)*^ + BGWg'^B^ + V 

(38) 


P(N) = S 

(39) 


2(0) = Eq 

iko) 


where, as in the continuous time case, P(k) = 2K(k) = P (k). Note that in the 
discrete-time case, it has been possible to obtain G explicitly in ( 36 ). {It 
is assumed that 2(k) is positive definite, C has rank il, so that C!!(k)C , is 
positive definite. A sufficient condition for E(k) to be positive definite for 
k > 0 is that 2(0) is positive definite, although this is not necessary.) 

Equations (36) to (Uo) define a nonlinear matrix two point boundary-value 
problem. It can be verified that these conditions are equivalent to those ob- 
tained in reference (7) using dynamic programing. 

Infinite Duration Case 

As in the continuous time case, if A, B, C, V, W, and G are constant and 

(A + BGC) is stable, it can be shown that the state covariance matrix ■+• E > 

0 as k and satisfies (38) with E^^^ = E^^. Furthermore, it is assumed that 

E is positive definite for the V, W, and G and the dynamics under consideration. 

T T 

This would indeed be true if (V + BGWG B ) is positive definite. As in the 
continuous case, the modified performance function is 

N-1 

J = lim ^ E ^ Etx*''(k)(ix(k) + u*^(k)Ru(k)] (Ul) 

N-h» “ k=0 
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or 


J = |- Tr |(Q + C^g’’rGC)s| + ^Tr(G’’RGW) (U2) 

For this static optimization problem having the constraint (38) with 


S =2 = Z, define the Lagrangian as 

k+1 k 


H(S,G,K) = I Tr [(Q + C^G^’^RGOE j + | Tr[G'^RGW] 

+ Tr[|(A + bgc)2(a + 800)"^ + bgwg^b'^ + V - sJ 


(i»3) 


where K is the n x n matrix of Lagrange multipliers. The necessary conditions 

3H 3H 3H 

are obtained by equating — , and — to zero: 

91 9K 


G = -(R + b'^PB)"^B^PAZc'^(CZc'^ + W)"^ 
p = Q + c'^g'^RGC + (a + BGC)^P(A + BGC) 
2 = (A + BGC)Z(A + BGC)”^ + V + BGWg'^B^ 


(4U) 

(U5) 

(U6) 


where, as in the continuous case, P = 2K = p'^. This is a set of nonlinear 
matrix algebraic equations. Since R > 0, S > 0 and rank (C) - i, the inverses 
in (Ui+) exist o 

A Numerical Algorithm 

Considering first the finite terminal time case, let Gr^(k) and G^(k) be 
tvo feedback gains, such that 

Z^{k+l) = (A + BG^C)E^(k)(A + BG^C)'^ = BG^WG^^’b'^ + V, i = 0, 1 {hi) 


and 

P°(k) = Q + C^g'^'^RG^C + (a + BG°C)'^P^ (k+l)(A + BG^C) (^9) 

After a lengthy manipulation as outlined in Appendix B, it can be proved 

that 

J(G°) - J(G^) = “ E^ Tr[(CE^C^ + W) j(G° + g)’^(R + BV(k+l)B)(G° + g) 

^ k»0 L I 

- (G^ + g)'^(R + B'^P°(k+l)(G^ + g)jj (U9) 

where 


lU 



(50) 


g = (R + BV(k+l)B)“^BV(k+l)AZ^c’^(Ci:V + W)”^ 

In writing equations (i+T) through (50), ‘(k) has been dropped in most places for 
convenience, except when required for clarity. Letting. 

= -g (51) 

in (li9), we have 

J(G°) - J(G^) > 0 (52) 

Thus, a minimizing algorithm is 

(a) choose initial G*^(k) 

(b) obtain P*^(k), k = 0...,N from the linear equation (48) 

(c) obtain Z^(k) by solving the nonlinear difference equation obtained 

by substitution of ( 51 ) in (47) 

(d) obtain G^(k) using P^(k+l) and £^(k) determined in the above steps 

(e) go to (b), with the superscript raised by unity 

Thus a successive reduction in J is obtained. For the infinite terminal 
time case, after a similar manipulation (given in the Appendix B), it can be 
shown that 

J{(P) - J(G^) = I Tr [(CSc’^ + W)|(G° + g)^(R + b'^P°B)(G° + g) 

- (G^ + g)^(R + bVb)(G^ + g)jj (53) 

where and P*^ satisfy the static versions of (4 t) and (48), and 

g « (r + b'^p°b)“^b'^p°a2^c^(cS^c'^ + W)"^ (54) 

Thus J(G^) < J(G^) with G^ = ~g, and the resulting sequence of G^'s 
improves the value of J successively if each (A + BGC) is stable, and each 

r > 0. 

Thus, a numerical algorithm similar to that for the finite terminal time 
case is obtained. 
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CONCLOSIONS 


The practically important problem of obtaining an optimal output feedback 
control law for lineair systems subjected to both forcing and measurement noise 
was considered. Necessary conditions for optimality were obtained for continu- 
ous-time and discrete-time systems, using the matrix minimum principle. Both 
finite and infinite terminal time cases were considered for each problem. Al- 
gorithms were derived for obtaining sequences of feedback gains which guarantee 
a monotonic improvement of the performance function. The method developed 
provides a powerful and practically feasible design technique in which the a- 
priori knowledge of the noise statistics is used to advantage. 

Although the necessary conditions for a minim\jm were obtained, the question 
of existence is still unanswered, and needs further attention. Also, the con- 
vergence properties of the sequences of feedback gains generated deserve more 
attention. 

For the infinite terminal time case, it was assumed that 5 > 0. The case 
2=0 will be a simple extension of the work of McLane (reference (6)); however, 
the case 2 > 0 needs fxirther investigation. Also, the technique developed in 
this paper can be easily modified for the design of optimal dynamic compensators, 
by following a procedure similar to that by Levine et. al, (reference (U)). 
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APPEHDIX A 


ALGORITHM FOR SUCCESSIVE REDUCTION OF THE 
PERFORMANCE FUNCTION; CONTINUOUS TIME CASE 

Since 

^ jTr(S°- 2^)P°| = Tr 2^)| P°j + Trj(E°- Z^) (A-1) 

After simplification using eq^uation (21) and (22) and integrating both sides 
between 0 and t^, 

J(G°) - J(G^) = Hr [B(G°- G^)CI:^P°] dt 

o 

+ ^ Tr [E^(c'^G°^RG°C - C^G^'^EG^C)] dt 
o 

+ ~ Tr J ^ B(g‘^WG^ - G^G^^)b'^P° dt (A-2) 

o 

Using the trace identities in reference (8), it can be proved that 
equations (A-2) and (23) are equivalent. 

Infinite Terminal Time Case 

In this case, the equations (l3) and (lU) take on their steady-state forms 
with S replacing I. Now, 

Tr[0*P°] + Tr[(2°- S^)0] = 0 (A-3) 

But 

(A + BG°C)E° + !!°(A + BG°C)^ + BG^G^^b'^ 

- [(A + BG^C)S^ + S^(A + BG^C)^ + BG^WG^'^b'^] = 0 (A-lt) 

and 

-(A + BG°C)"^P° - P°(A + BG°C) - (Q + c'^G^'^RG^C) = 0 (A-5) 
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Replacing the first and second null matrices in (A-3) by left-heuid sides 
of (A-h) and (A-5), respectively, after simplification, 

J{G°) - J(G^) = Tr[B(G°- G^)c 2^P°] + I* Tr[S^(c'^G*^RG°C - c'^G^^RG^C)] 

+ I Tr {tB(G°WG°^ - G^WG^^)b'^]P°} (A-6) 

Similar to the finite terminal time case (A-6) can "be shown to be equivalent to 
(23), with integral signs removed, and replaced by 
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APPENDIX B 


ALGORITHM FOR SUCCESSIVE REDUCTION OF THE PERFORMANCE 
FUNCTION: DISCRETE-TIME CASE 


The expression 

Tr[(I°(k+l) - i:^(k+l))p'^(k+l)] - Tr( (Z°(k) - Z^(k))P°(k)l 

can "be shovn to he equal to the following expression, after substitution for 
[Z°(k+1) - Z^(k+1)] from {hj) and for p'^(k) from (48), respectively, in its 
first and second terms, and after some manipulation: 

Tr[B(G^WG*^*^ - G^WG^^)B^P°(k+l ) ] - 2 Tr(AZ^C^(G^- G^)^B*^P^(k+l) ] 

- Tr[Z^C^(G^'^B'^P°(k+l)BG^ - G°^B'^P®(k+l)BG‘^)C] 

- Tr[(Z° - Z^)(C^G%g‘^C + Q)] 

After summing the two expressions above from k = 0 to N - 1, and after 
some manipulation, the following equation is obtained 

J(G°) - J(G^) = -~”z^ Tr[(BG°WG°'^B‘^ - BG^WG^'^B'^)P°(k+l) 1 
^ k=0 


- Tr[AZ^c'^(G^ - G^)^B'^P°(k+l)] 
k=0 

+ i ""z" Tr[z"c^(G‘^BV(k-Hl) BG° - G^W(k4l) BG^)C] 
^ k=0 

+ i Z^ Tr[Z^c'^(G°^RG'^ - G^'^RG^)C] 

^ k=0 

+ i Z Tr[(G^RG° - G^'^RG^)W] 

^ k=0 


19 



Using the trace identities in reference (8), it can be shown that (B-l) 
and ( 49 ) are equivalent. 

Infinite Terminal Time Case 

In this case equations (37) and (38) become equations (1+5) and (^*6), 
respectively. Now, 

Tr[(^-r^)P®] - Tr[(Z^-I^)P°] = 0 

Substitution for (^- 2^) in the first term using equation (46), and for P in 
the second term, using equation (45), and proceeding exactly as for the infinite 
terminal time case, equation (53) can be obtained. 
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